{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### 结果展示"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "##### BPIC 2012\n",
    "| Policy | Loss | #Predictions |\n",
    "| ------ | ---- | ------------ |\n",
    "| 预测每个点 | 56.52 | 31.8 |\n",
    "| 随机选点 | 54.07 | 6.5 |\n",
    "| 每隔1个点预测 | 53.39 | 16.26 |\n",
    "| 每隔2个点预测 | 53.97 | 10.92 |\n",
    "| 每隔3个点预测 | 54.00 | 8.4   |\n",
    "| 每隔4个点预测 | 55.10 | 6.7   |\n",
    "| 每隔5个点预测 | 54.63 | 5.8   |\n",
    "| 每隔6个点预测 | 56.96 | 4.92  |\n",
    "| 每隔7个点预测 | 58.58 | 4.44  |\n",
    "| 每隔8个点预测 | 55.12 | 3.98  |\n",
    "| 每隔9个点预测 | 56.62 | 3.68  |\n",
    "| DQN-随机选样本 | **53.18** | **5.78** |\n",
    "| DQN-优先选择reward小的样本训练 | **52.72** | **3.7** |"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### BPIC 2013\n",
    "| Policy | Loss | #Predictions |\n",
    "| ------ | ---- | ------------ |\n",
    "| 预测每个点 | 49.40 | 20.46 |\n",
    "| 随机选点 | 56.10 | 11.12 |\n",
    "| 每隔1个点预测 | 51.19 | 10.48 |\n",
    "| 每隔2个点预测 | 51.68 | 7.12 |\n",
    "| 每隔3个点预测 | 56.60 | 5.54   |\n",
    "| 每隔4个点预测 | 55.65 | 4.48   |\n",
    "| DQN-随机选样本 | 51.88 | 4.78 |\n",
    "| DQN-优先选择reward小的样本训练 |  |  |"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### BPIC 2015\n",
    "| Policy | Loss | #Predictions |\n",
    "| ------ | ---- | ------------ |\n",
    "| 预测每个点 | 137.66 | 36.82 |\n",
    "| 随机选点 | 130.24 | 19.46 |\n",
    "| 每隔1个点预测 | 133.53 | 18.68 |\n",
    "| 每隔2个点预测 | 140.13 | 12.62 |\n",
    "| 每隔3个点预测 | 127.86 | 9.52   |\n",
    "| 每隔4个点预测 | 134.34 | 7.72   |\n",
    "| 每隔5个点预测 | 133.08 | 6.58   |\n",
    "| DQN-随机选样本 | 155.73 | 4.19 |\n",
    "| DQN-优先选择reward小的样本训练 | 137.65 | 6.94 |"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Hospital Billing\n",
    "| Policy | Loss | #Predictions |\n",
    "| ------ | ---- | ------------ |\n",
    "| 预测每个点 | 1712.57 | 16.26 |\n",
    "| 随机选点 | 1804.00 | 8.94 |\n",
    "| 每隔1个点预测 | 1785.72 | 8.3 |\n",
    "| 每隔2个点预测 | 1791.29 | 5.72 |\n",
    "| 每隔3个点预测 | 1874.69 | 4.42   |\n",
    "| DQN-随机选样本 | 1877.86 | 4.95 |\n",
    "| DQN-优先选择reward小的样本训练 | *1816.10* | *4.54* |\n",
    "1895.9839428306857 3.632"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Environmental Permit\n",
    "| Policy | Loss | #Predictions |\n",
    "| ------ | ---- | ------------ |\n",
    "| 预测每个点 | 125.61 | 38.64 |\n",
    "| 随机选点 | 125.60 | 20.3 |\n",
    "| 每隔1个点预测 | 128.16 | 19.6 |\n",
    "| 每隔2个点预测 | 130.36 | 13.18 |\n",
    "| 每隔3个点预测 | 130.89 | 10.0   |\n",
    "| 每隔4个点预测 | 123.56 | 8.14   |\n",
    "| 每隔5个点预测 | 117.40 | 6.88   |\n",
    "| 每隔6个点预测 | 121.51 | 5.9   |\n",
    "| 每隔7个点预测 | 129.77 | 5.22   |\n",
    "| DQN-随机选样本 | 162.60 | 5.35 |\n",
    "| DQN-优先选择reward小的样本训练 |  |  |"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "nash",
   "language": "python",
   "name": "nash"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.7"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}
